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IN THE CLAIMS 

The following listing of the claims is provided in accordance with 37 C.F.R. 

§1.121. 

1. (original) A method of image reconstruction comprising: 
obtaining a Helmholtz reciprocal pair of images of an object, said Helmholtz 

reciprocal pair of images comprising a first image and a corresponding reciprocal image; 

determining a geometry associated with said obtaining of said Helmholtz 
reciprocal pair of images; 

selecting a plurality of points in said first image and identifying corresponding 
candidate points in said corresponding reciprocal image; 

matching a selected point of said plurality of points and a candidate point of said 
corresponding candidate points. 

2. (original) The method of Claim 1 wherein said obtaining includes: 
capturing a first image of said image pair with a first receiver at a first optical 

center and a first source at a second optical center; and 

capturing a second image of said image pair with at least one of said first receiver 
and a second receiver at said second optical center, and at least one of said first source 
and a second source at said first optical center. 

3. (original) The method of Claim 2 wherein at least one of said first 
receiver and said second receiver are cameras and at least one of said first source and said 
second source is a light source. 

4. (original) The method of Claim 1 wherein said determining includes: 
establishing a position corresponding to a first optical center relative to said 

object; 



Serial no. 10/678,244 
Response to Final Office Action mailed on August 31, 2007 

Page 3 

establishing a position corresponding to a second optical center relative to said 
object; and 

computing an epipolar geometry based on said first optical center and said second 
optical center. 

5. (original) The method of Claim 1 wherein said selecting includes: 
selecting an epipolar line in said first image and a corresponding epipolar line in 

said corresponding reciprocal image based on an epipolar geometry; 

selecting an adjacent pair of points on said epipolar line in said first image of said 

reciprocal pair of images; 

applying an ordering principle based on said adjacent pair of points; and 
selecting a candidate matching point on said corresponding epipolar line in said 

corresponding reciprocal image. 

6. (original) The method of Claim 1 wherein said matching includes: 
computing a depth and a normal for a candidate point in said corresponding 

reciprocal image; 

applying Helmholtz reciprocity; 

predicting an intensity for said candidate point, based on a measured intensity of 
said selected point in a first image; and 

comparing said predicted intensity with a measured intensity associated with said 
candidate point in said corresponding reciprocal image, forming an error based on said 
comparing; 

refining said predicting based on said error. 



7. (original) The method of Claim 6 wherein said predicting is based on 
the equation: 
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/ 21 =/ 12 n ' Vl ^ 2 ~ P ^ 
where 

11,2 denotes intensity measured at optical center clwith source located at optical 
center c 2; 

n-vl denotes projection of the normal vector at point p in the direction of vl; 
H° 2 denotes depth for optical center c 2 ; and 
H Cl ^11 denotes depth for optical center c2 . 

8. (original) The method of Claim 6 wherein said predicting is in 
agreement with a BRDF associated with a point on said object corresponding to said 
selected point. 

9. (original) The method of Claim 6 wherein said predicting is 
independent of a BRDF associated with a point on said object corresponding to said 
selected point. 

10. (original) The method of Claim 6 wherein said predicting includes 
specularities in said reciprocal pair of images. 

1 1 . (original) The method of Claim 6 wherein said predicting includes 
leveraging effects of shadows and occlusions to enhance robustness of said predicting. 

12. (original) The method of Claim 6 wherein said refining includes 
dynamic programming. 

13. (original) The method of Claim 6 wherein said refining includes a 
global nonlinear optimization algorithm. 
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14. (original) The method of Claim 6 wherein said refining further 
includes establishing a parametric model and updating a parameter of said model. 

15. (original) The method of Claim 6 wherein said refining is 
compensated to mitigate effects of saturation or blooming. 

16. (original) A method of image registration with an object comprising: 
obtaining a Helmholtz reciprocal pair of images of an object, said Helmholtz 

reciprocal pair of images comprising a first image and a corresponding reciprocal image; 
estimating a pose for said object; 

predicting an estimated image corresponding to said pose and one image of said 
reciprocal pair of images; 

comparing said estimated image with a corresponding actual image from said pair 
of images; and 

refining said estimating a pose based on said comparing. 

17. (original) The method of Claim 16 wherein said obtaining includes: 
capturing a first image of said image pair with a first receiver at a first optical 

center and a first source at a second optical center; and 

capturing a second image of said image pair with at least one of said first receiver 
and a second receiver at said second optical center, and at least one of said first source 
and a second source at said first optical center. 

18. (original) The method of Claim 17 wherein at least one of said first 
receiver or said second receiver are cameras and at least one of said first source and said 
second source is a light source. 

19. (original) The method of Claim 16 wherein said estimating includes 
establishing an initial position and orientation in three-dimensional space for said object. 
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20. (original) The method of Claim 16 wherein said predicting includes: 
determining an intensity for a plurality of candidate points, based on a measured 

intensity of a corresponding plurality of selected points in a first image of said reciprocal 
pair of images. 

21. (original) The method of Claim 20 wherein said predicting is based 
on the equation: 

j n - v iiK-pir 

n-v 2 | Cl -p| 

where 

11,2 denotes intensity measured at optical center clwith source located at optical 
center c2; 

n-vl denotes projection of the normal vector at point p in the direction of vl; 
i° 2 Pi denotes depth for optical center c2 ; and 
H Cl denotes depth for optical center c2 . 

22. (original) The method of Claim 20 wherein said predicting is in 
agreement with a BRDF associated with a point on said object corresponding to said 
selected point. 

23. (original) The method of Claim 20 wherein said predicting is 
independent of a BRDF associated with a point on said object corresponding to said 
selected point. 



24. (original) The method of Claim 20 wherein said predicting includes 
specularities in said reciprocal pair of images. 
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25. (original) The method of Claim 20 wherein said predicting includes 
leveraging effects of shadows and occlusions to enhance robustness of said predicting. 

26. (original) The method of Claim 16 wherein said comparing includes 
determining an error based on a difference between a selected plurality of points on said 
estimated image and a selected plurality of corresponding points on said corresponding 
actual image. 

27. (original) The method of Claim 16 wherein said refining includes 
dynamic programming. 

28. (original) The method of Claim 1 6 wherein said refining includes a 
global nonlinear optimization algorithm. 

29. (original) The method of Claim 16 wherein said refining further 
includes: 

establishing a parametric model; and 

updating parameters of said model to improve agreement between said estimated 
image and said corresponding actual image. 

30. (original) A computer-readable medium encoded with a machine-readable 
computer program code, said code including instructions for causing a computer to 
implement a method for image reconstruction, the method comprising: 

obtaining a Helmholtz reciprocal pair of images of an object, said Helmholtz 
reciprocal pair of images comprising a first image and a corresponding reciprocal image; 
determining a geometry associated with said obtaining; 

selecting a plurality of points in said first image and identifying corresponding 
candidate points in said corresponding reciprocal image; 
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matching a selected point of said plurality of points and a candidate point of said 
corresponding candidate points. 

3 1 . (canceled) 

32. (original) A system for image reconstruction comprising: 

a means for obtaining a Helmholtz reciprocal pair of images of an object, said 
Helmholtz reciprocal pair of images comprising a first image and a corresponding 
reciprocal image; 

a means for determining a geometry associated with said obtaining; 

a means for selecting a plurality of points in said first image and identifying 
corresponding candidate points in said corresponding reciprocal image; 

a means for matching a selected point of said plurality of points and a candidate 
point of said corresponding candidate points. 

33. (previously presented) A computer-readable medium encoded with a 
machine-readable computer program code, said code including instructions for causing a 
computer to implement a method for image registration with an object, the method 
comprising: 

obtaining a Helmholtz reciprocal pair of images of an object, said Helmholtz 
reciprocal pair of images comprising a first image and a corresponding reciprocal image; 
estimating a pose for said object; 

predicting an estimated image corresponding to said pose and one image of said 
reciprocal pair of images; 

comparing said estimated image with a corresponding actual image from said pair 
of images; and 

refining said estimating a pose based on said comparing. 



Serial no. 10/678,244 
Response to Final Office Action mailed on August 31, 2007 

Page 9 

34. (canceled) 

35. (original) A system for image registration with an object comprising: 
a means for obtaining a Helmholtz reciprocal pair of images of an object, said 

Helmholtz reciprocal pair of images comprising a first image and a corresponding 
reciprocal image; 

a means for estimating a pose for said object; 

a means for predicting an estimated image corresponding to said pose and one 
image of said reciprocal pair of images; 

a means for comparing said estimated image with a corresponding actual image 
from said pair of images; and 

a means for refining said estimating a pose based on said comparing. 



